Spoken Dialogue for Virtual Advisers in a semi-immersive Command and Control environment
نویسندگان
چکیده
We present the spoken dialogue system designed and implemented for Virtual Advisers in the FOCAL environment. Its architecture is based on: Dialogue Agents using propositional attitudes, a Natural Language Understanding component using typed unification grammar, and a commercial speaker-independent speech recognition system. The current application aims to facilitate the multimedia presentation of military planning information in a semi-immersive environment.
منابع مشابه
Intelligent Multi Media Presentation of information in a semi-immersive Command and Control environment
We describe the framework for an intelligent multimedia presentation system we designed to be part of the FOCAL laboratory, a semi-immersive environment for Command and Control Environment. FOCAL comprises a number of input devices and output media, animated virtual conversational characters, a spoken dialogue system, and sophisticated visual displays. These need to be coordinated to provide a ...
متن کاملThe FOCAL Point – Multimodal Dialogue with Virtual Geospatial Displays
The Future Operations Centre Analysis Laboratory (FOCAL) at Australia’s Defence Science and Technology Organisation (DSTO) is aimed at exploring new paradigms for situation awareness (SA) and command and control (C2) in military command centres, making use of new technologies developed for simulation, virtual reality, and real-time 3D animation. Recent work includes the development of a multimo...
متن کاملA Spoken Dialogue System for Navigation in Non-Immersive Virtual Environments
Navigation is the process by which people control their movement in virtual environments and is a core functional requirement for all virtual environment (VE) applications. Users require the ability to move, controlling orientation, direction of movement and speed, in order to achieve a particular goal within a VE. Navigation is rarely the end point in itself (which is typically interaction wit...
متن کاملSpoken Dialogue Agent Architecture for Web Service Mediator
In this paper, we propose a spoken dialogue agent architecture which can control virtual electronic devices via Web services. Each device is assumed to have Web service interface which can register its control functions and command ontology to the server. The dialogue agent can acquire dialogue knowledge from the server and dynamically change its dialogue transition rule according to the status...
متن کاملEvaluation of a hierarchical reinforcement learning spoken dialogue system
We describe an evaluation of spoken dialogue strategies designed using hierarchical reinforcement learning agents. The dialogue strategies were learnt in a simulated environment and tested in a laboratory setting with 32 users. These dialogues were used to evaluate three types of machine dialogue behaviour: hand-coded, fully-learnt and semi-learnt. These experiments also served to evaluate the ...
متن کامل